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Abstract 

We consider a system x{t) — {xi(t), . . . , XN{t)) consisting of N Brownian parti- 
cles with synchronizing interaction between them occurring at random time moments 
{r„}^j^. Under assumption that the free Brownian motions and the sequence {Tn}^^i 
are independent we study asymptotic properties of the system when both the dimen- 
sion N and the time t go to infinity. We find three time scales t — t{N) of qualitatively 
different behavior of the system. 

1 Introduction 

Mathematical models with stochastic synchronization between components take their origin 
from paper [1] where some two-dimensional system related with parallel computations was 
studied. A very good explanation of the role of synchronizations in asynchronous parallel 
and distributed algorithms can be found in p]. It is rather natural that further mathematical 
interest to such models was moved to considerations of high dimensions and to studies of a 
long time behavior. It was discovered soon O HI [5] that it is very convenient to interpret 
synchronization models as particle systems with very special interaction. It is worth to note 
that in the "traditional" mathematical theory of interacting particle systems such interactions 
were never considered before that time. In [llj one can find a short overview of the subject. 

The present paper is a small contribution to the following general problem: how to de- 
scribe a qualitative behavior of a mutidimensional Markov (or semi-Markov) process x{t) = 
{xi{t), X2{t), . . . ,xj\f{t)) for large and t = t{N). We chose as an object of our study the 
system of N Brownian particles perturbed by synchronizing jumps at some random time mo- 
ments. Reasons of such choice are the following. Synchronization models driven by Brownian 
motion were not studied yet, all papers mentioned above considered random walks on lattices 
or deterministic motions as non-perturbed dynamics. The second reason is that, as it will 
be shown here, a Markovian synchronization model based on the Brownian motions admits 
an explicit solution. This feature give us possibility to write very short and clear proofs of 
our main result on the existence of three different time stages of qualitative behavior of the 
particle system. We believe that such results hold also for very general multidimensional 
synchronization models. There are already many particular examples justifying this belief. 
Thus the existence of the three time stages in the long time behavior was already proved for 
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system with two types of deterministic particles and pairwise stochastic synchronizations [U], 
for discrete time random walks with a 3-particle anysotropic interaction [5], for continuous 
time random walks with symmetric fc-particle synchronizations [7J. 

The explanatory goals of this paper force us to chose the following organization of sections. 
In Section 2 we define and study a sequence of Markov models with pairwise synchronization 
between particles and constant coefficients in the front of the free dynamics and the interac- 
tion. This lets us avoid cumbersome notation in proofs (Section 3). Section 4 is devoted to 
generalizations of the model of Section 2. The first generalization to the case of coefficients 
varying with N is quite straightforward and is based on a careful analysis of the proofs in 
Section 3. The next extension of the main results is done for general symmetric fe-particle 
synchronizing interaction. In Subsection 4.3 we discuss generalizations to the case when 
epochs of synchronization form a general renewal process and hence the particle system is no 
more a Markov process. Corresponding results are obtained by using the Laplace transform 
and are presented in Theorem |6l 

2 Model with pairwise interaction 

2.1 Definition and assumptions 

We study a multi-dimensional stochastic process 

x{t) = {xi{t),X2{t), . . . ,XNit)) G M^, te R+, 

which can be regarded mathematically as a special class of interacting particle systems. But 
from the view point of possible applications it would be better to consider this process as a 
multi-component stochastic system. 

Here is the number of particles and Xi{t) S is a coordinate of the z-th particle at 
time t. Denote Mn = {1, • • • , N}. To give a precise construction of the process {x{t), t > 0) 
we fix on some probability space 

(a) B{t) = {Bi{t), . . . ,Bi\f{t)) — the A^-dimensional standard Brownian motion, 

(b) a random sequence {Tn}'^^i of time moments 

= To < Ti < T2 < ■ ■ ■ 

(c) a random initial configuration of particles x(0) = (xi(0), 2:2(0), . . . ,X]sr{0)). 

Main assumption is that {B{t), t > 0), {Tn}^^i and x(0) are independent. 

We consider also another probability space (0', J^', P') corresponding to the independent 
sequence 

ihJl), {12,32), • • • , {in, in), ■■■ (1) 

of equiprobable ordered pairs {i,j) such that i,j G A/jv, i 7^ j. In the next we will put simply 

n,jn), • • •) snd will use coordinate functions iyi{u)') — i^ and 

jn(w') = in- 

Let us introduce the new probability space {Q., T, P) = ^il x 0', P x F' , P x P'^ . By for- 
mal definition the process {x{t), t>Q) has right-continuous trajectories {x{t,uo), i > 0), w = 
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(tD,^'), satisfying to the following conditions: 

Xk{s,U)) - XkiTnioj),Uj) = a ■ {Bk{s,U)) - Bk{Tn{co),U})) , 

Vs e [Tnioj),Tn+l{u})), V/c G Mn , 

XmiTniu}),^^) = Xm(T„(a)) - 0,tj) Vm G 7VAr\ { j„ (w') } • 
The scalar parameter o" > is a diffusion coefficient. 

Informally speaking the dynamics of the process x{t) consists of two parts: free motion 
and pairwise interaction between particles. Namely, the interaction is possible only at random 
time moments 

<Ti <T2 < ■■■ 

and has the form of synchronizing jumps: at time r„ with probability ^y^^^^^-^^ a pair of 
particles is chosen and the particle j jumps to the particle i: 

(xj,Xj) y (2) 

Inside the intervals (t^jT^+i) particles of the process x{t) move as independent Brownian 
motions with diffusion coefficient a {free dynamics). 

In some sense the dynamics of the interacting particle system x{t) can be considered 
as a perturbation of the stochastic dynamics B{t). We are interested in the question how 
the synchronizing interaction will imply on a long time behavior of x{t). We consider the 
following limiting situations: 

(i) N is fixed, t oo; 

(ii) ^ oo is fixed, t = t{N) — >■ oo with different choices of the time scales t{N). 

We shall mainly be concerned here with the situation (ii) which is more important and more 
interesting. 

To make our considerations more transparent in all subsequent sections we have the next 
assumption. 

Assumption M. The moments {Tn}^^i are epochs of a Poisson flow of intensity 5, i.e., the 
sequence {r„ — t„_i}^^ consists of independent random variables, having exponential 
distributions: P (r„ — r„_i > s) = exp{—5s). 

Assumption M implies immediately that {x{t), t > 0) is a Markov process on with sym- 
bolic generator 

aL^ + 6Ls, 0- > 0, 5>0, 

where Lq is a generator of the standard A^-dimensional Brownian motion and Lg corresponds 
to synchronizing jumps. 

This assumption is not crucial for the validity of our asymptotic results. In Subsection 14.31 
we shall discuss the case of a general renewal process. 

2.2 Long time behavior for fixed 

We use notation C for a distribution law of a random element ^. Then {£. {x{t)) , t >0) 
is a family of probability measures on (M^,S (R^)). 
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Theorem 1 L {x{t)) has no limit as t — )• cx). 

We recall the well known fact that the Brownian motion B{t) also has no limit on distri- 
bution as t — > oo. But a long time behavior of the interacting particle system x{t) strongly 
differs from the behavior of B(t). Indeed, let us consider an "improved" process x°(t), 

x°{t)=Xi{t)-M{x{t)), 

N 

where M(x) ■= is the center of mass of the particle configuration x = (xi, . . . , xat). 

m=l 

In other words, x°{t) is the particle system x{t) viewed by an observer placed in the center 
of mass M{x{t)). 

Theorem 2 For any a > 0, (5 > the Markov process x°{t) is ergodic. Hence there exists a 
probability distribution on (W^ ,B (R^)) such that L — )• /x^ as t ^ oo. 

The idea of the proof is to show that x°(t) satisfies the Doeblin property. Similar argu- 
ments were used in [51 1^ . So we omit here the proofs of Theorems [1] and [2j 

The result of Theorem [2] is close to the shift- compactness property of measure- valued 
stochastic processes |9]. 

It would be interesting to answer the following main questions. What is a typical "size" of 
the configuration (xi, . . . ,X]\f) under the distribution /x^? How large (with respect to is a 
domain where /Uat is supported with probability close to 1? To do this we let the dimension N 
and the time t grow to infinity in order to find on which time scale t = t{N) the process x{t) 
will approach /i^. 

2.3 Time scales 

In collective behavior of a particle system with synchronization we observe a superposition 
of two opposite tendencies: with the course of time the free dynamics increases the spread of 
the particle system while the synchronizing interaction tries to decrease it. 

To formalize the notion of a "size" or a "spread" we consider the following function on the 
state space 

1 ^ 

m=l 

where M(x) is the center of mass as defined above. In statistics the function V is known as 
the empirical variance. We introduce also the function R]\f : M+ — )• M+ depending on the 
time t > as 

RNit):=EVix{t)). (3) 

It appears that the function R]\f{t{N)) has completely different asymptotic behavior for 
different choices of the time scale t = t{N). Before proving this result we start from the 
following explicit formula. 

Theorem 3 There exist a number x > such that 

R^(t) = cr^(5"^ In (1 - exp {-5t/lN)) + exp {-5t/lN) Rn{^), 
where In = N{N - 
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This statement shows that the function i2Ar(t) satisfies to a very simple differential equation 

at I TV 

So the choice of i? at in ([3]) was really good from the point of view of subsequent asymptotic 
analysis. 

In the next theorem we assume that N — )• c«, t = t{N) — t- oo. 
Theorem 4 (On three time scales) Let supi?Ar(0) < oo. Then 

N 



If -jp^^O, then RN{t{N)) a'^t{N). 



t{N) 

u 

II. If t{N) = cN^/ {x5), c> 



then RN{t{N)) a'^t{N). 



c 



III. If ^ ^ cx), then RN{t{N)) r^(— ]N^. 



Remark 1. In case 5 = when there is no synchronization and x{t) behaves as the 
Brownian motion aB(t) the function iJ^v can be calculated explicitly: RN{t) = • 
Remark 2. The function / in the item II is strictly decreasing: 

/(c) = ^^^, /(0) = 1, /'(c) <0, /(+oo) = 0. 
c 

Remark 3. For the pairwise synchronization ([T|) and ([2]) considered in the present section 
X = 2. Details will be given at the end of Subsection 14.21 

2.4 Discussion of collective behavior 

We can easily observe from Theorem [J] that for the slowest time scale (case I) asymptotic 
behavior of R]sf{t{N)) is the same as for non-perturbed dynamics. This means that a cumula- 
tive effect of synchronization jumps on time intervals of the form (0, o{N'^)) is negligible with 
respect to the influence of the free dynamics. Next observation is that on the fastest time 
scale (case III) asymptotics of Ri\f{t{N)) does not depend on the rate of grow of t = t(N). 
We interpret this phenomenon as follows: synchronization dominates heavily on the free mo- 
tion and the asymptotics {a"^ /26)N'^ corresponds to the averaging of the function f{x) with 
respect to the limiting distribution /x^. The asymptotics on the middle time scale (case II, 
time intervals of the form (ci A^^, C2A^^)) "continuously joins" the asymptotics of the slowest 
and the fastest time stages. 

As in [6] one can call these consecutive stages correspondingly: 

I initial desynchronization 

II critical slowdown of desynchronization 

III final stabilization. 



5 



3 Proofs 



3.1 Proof of Theorem g] 

Let lit = max{m : Tm <t} and = TUf Obviously, r^* = max{rj : Tj < t}. To get i?Ar(t) 
we shall calculate the chain of conditional expectations as follows 

E(.) = E(E(E(.|{r,}-,)|n,)). 



Lemma 1 

Ut-l 



E (V{x{t) I {T,}f^A =a'Y^ • (r,+i - n) + a' ■ {t - r,*) + k'^^RNiO) (4) 



i=0 



where '■= ^1 



N{N-l) 



To take expectation E(- lilt) from the both sides of equation we need to know the 
joint distribution of the following form 

P {Tq - Tg_i e (x, x + (ix), lit = n} , q<n 

and the expectation of the spent waiting time (t — r*) in terms of |10| . 

Lemma 2 If Assumption M holds we have that (IIj, t > 0) is the Poisson process and 

E (r, - Tg_i I Ht = n) = E (t - Tt* I Ht = n) = 

Keeping in mind Lemmas [1] and [2] we can easily proceed with calculation of R]\f{t). Under 
Assumption M 



n-l 



t 2 t 



E(y(x(t)|nt=n) = a^Y.kl''^-+a 



n + 1 n + 1 

n + l^^ 71 + 11-% JVivw 

j=0 

Moreover, for given t > the random variable lit has the Poisson distribution with mean 5t. 
Using identity 



we get 



^7v(t) = y^E{V{x{t)\Ut = n) ^exp{-6t) 

n=0 

aH feMSt)-l (-P(^^'^*)-l)^^\exp(-5t) + exp(-(l-M'^t)i?^(0) 



I — kN \ St kj^dt 
0-2 1 -exp(-(l - kN)5t) 



6 1 — k^ 



+ exp{-{l-kN)St)RNiO) 



Putting /jv = (1 — k]\f) we obtain statement of Theorem [31 

3.2 Proof of Theorem H 

Our task is to analyze asymptotic behavior of 

RN{t{N)) = a^6'^ In (1 - exp (-5t(iV)//jv))+exp {-dt{N)/lN) Rn{0) , In = N{N-l)/x, 

for different choices of t = t{N). Let N — )• oo. 
Case I: t{N)/lN 0. Then 

RN{t{N)) ~ £7^(5-^ In 6t{N)/lN = a'^t{N) . 

Case II: t{N)/lN c5~^ for some c > 0. We have 

RN{t{N)) ~ a^6-^ t{N)c-^6 (1 - exp (-c)) = a^t{N) (1 - exp (-c)) /c. 

Case III: t{N)/lN — > +oo. Here we get 

2 

ox 

Theorem 3] is proved. 

3.3 Proofs of Lemmas 

Let us introduce famihes of cj-algebras which are generated = c ((^^(s), s < r^) , {Tj}^-|^) 
as fohows 

= {{x{s), S < Tm) , {Ti}'^^^) , m = 0, 1,... 

Jm_ = o- ((a;(s), s < - 0) , {rjj^^) , m = l,2,.... 
Denote also J-q- = a ( {Tj}^-^). Evidently, 

J-Q- C Jo C • • • C C /"m C -^(m+l)- C C • • • 

To prove Lemma [J we shall use the following result related with synchronizing jumps. 
Lemma 3 There exists x > such that for any m E N 

0)), 

where kN={l-j^^^^^ e(0,l). 

We postpone the proof of this lemma Subsection 14.21 where the same statement will be 
established for more general interactions. Here we just note that in the case of pairwise 
synchronizations x = 2. 

Since the free dynamics of particles corresponds to Brownian motions independent of the 
sequence {tj}^^ of synchronization moments, for any m € N we have 

E {V{x{Tm+l - 0)) I Trn) = V {x{Tm)) + ■ (jm^-l - Tm)- 
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Using Lemma |3] we get 

) (5) 

Hence, iterating ^ we come to the equation 

E{V{x{Tm+i))\Tm-i) = E(E(y(a;(rm+i)) I Jm) I-Fm-l) = 

= kiyE iV{x{Tm)) I Tm-l) + ' (Tm+1 " T^) 

By developing this recurrent equation we obtain 

n— 1 

E (v{x{Tn) I {T,}Jl,) =a'Yl ^N~' in+l - n) + klRN{Q). 

i=0 

In a similar way we get for any nonrandom t > 

nt-i 

i=0 

Here we take into account that all tj have continuous distributions and, as usually, the sign 
"=" for conditional expectations is understood in the sense of "almost surely" [12] . 
This completes the proof of the Lemma [TJ 

Lemma [2] follows from the well know facts of renewal processes theory [14^ [15] or can be 
verified by a direct calculation in our concrete case. 

4 Generalizations 
4.1 Varying parameters 

Since Theorems [3] and U deal with the sequence {x{t) = {xi{t), . . . ,X7v(i)}^=i of stochastic 
processes is it natural to ask whenever these statements remain true if we let the coefficients 
a and 5 depend on N. In other words under Assumption M we consider a family of Markov 
processes defined on the state spaces (M^,,B (M^)) with formal generators 

ctatL^ + 5nLs, ctn >0, 5n > 0- (6) 

If we check carefully all calculations and arguments in the proofs of Theorems [3] and H] we 
see that these proofs are valid without any modification for the case ([6]). The corresponding 
results are summarized in the next theorem. 

Theorem 5 

1. There exist a number x > (not depending on N) such that 

RN{t) = a%5jl In (1 - exp {5Nt/lN)) + exp {-5Nt/lN) Rn{0), (7) 
where In = N{N - 

2. Let N — 7> oo, t = t{N) oo. Assume that supi?iv(0) < oo. There are three different 

N 

time stages in the collective behavior of the particle system: 
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/ 


II 


III 




On 


ajy — > c > 


ajy — ^ oo 


RN{t{N)) ~ 




{l-e-')c-^a%t{N) 





>€6n t{N) 
where '■= 7775 • 

Remark 4. As it is seen from the representation d?]) the assumption supii7v(0) < 00 can 

N 

be weakened. We can let some growth of i?Ar(0) in the limit N ^ 00 and the statement 2 of 
Theorem [5] still remains true. But the conditions on the admissible growth will be different 
for each time stage. 

4.2 /c-particle synchronization 

Recall our assumption on pairwise interaction: we pick at random a pair of particles 
{xi,Xj) and move this particles as follows {xi,Xj) — > {xi,Xi). To study general problems 
of synchronization in stochastic systems with applications to wide classes of self-organizing 
systems we should face to so called multi-particle interactions. The most general rule of 
synchronizing jumps is 

X = (xi, . . . ,xn) x' = {x'l, . . . ,x'j^) 

where {x[, . . . , x'j^} C {xi, . . . , xjy} , {x'l, . . . , x'j^} ^ {xi, . . . ,xn} ■ Following the paper [7] 
we restrict ourself here to symmetric fc-particle interactions based on synchronizing maps. 
Definition of synchronizing maps needs some preliminary notation. First we introduce a set 

I := {{ii, ...,ik)- ij ^ -A/W, ip 7^ iq {PT^q)}- 

Fix integers k > 2 and ki > 2, . . ., ki > 2: ki + ■ ■ ■ + ki = k. The sequenced collection 
(ki, . . . ,ki) will be called a signature of interaction. Given the signature (ki, . . . ,ki) we 
introduce a map TTki,...,ki defined on the set I as follows: TTkx,...,ki ■ {h, ■ ■ ■ jik) (Fi, • • • , F;) , 
where F^ = (gj,T°) with 

91 = k, F° = (i2, . . . ,ifci), 

91 = iki+-+ki_i+i, F^ = [ik-^+...+ki^i+i, ■ ■ ■ ^iki+'-'+ki) ■ 
In other words the map 'TTkx,...,ki is a special regrouping of indices (ii, . . . ,ik)'- 

{il, . . . ,ik) = (il,i2, ■ ■ ■ ,iki, iki+l,iki+2, ■ ■ ■ ,'iki+k2^ • • • ) • • • )4) 



^l, l2,---,tki, Iki+l, • • • , «fci+fc2) 



91 F° 52 F 



2 



The map 'nki,...,ki generates a family of synchronizing maps (^i; ■ ■ ■ ,ik) £ ^| de- 

fined on the set of particle configurations: 

JkuZ'kf ■ X = {xi,. . . ,xn) ^ y = {yi,--- ,yN) , (8) 
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where 

_ I Xm, if m ^ {ii, ...,ik), 

\ Xgj, if m e {ii,. .. ,ik) , m eVj . 

We cah the jump ([8]) a synchronization of the collection of particles Xj^ , . . . , Xj^, , corresponding 
to the signature {ki,...,ki). The configuration Jk^' 'k^^x has at least /ci particles with 
coordinates that are equal to Xg^ , . . . , at least ki particles at the point x^, . 

We are ready now to define a particle system with symmetric k-particle interaction of 
the given signature {ki, . . . ,ki). To do this we repeat the strategy of Subsection 12. II but with 
another definition of the probability space ($7', T' , P'). Now the space (il', J-"', P') corresponds 
to the independent sequence 



(^1) • • • 5 



1,1,. 



of equiprohahle elements of the set X. As before the dynamics of x{t) consists of two parts: 
free motion and interaction. Inside the intervals (rfc,rfc_|_i) particles of the process x{t) move 
as independent Brownian motions with diffusion coefficient a {free dynamics). Interaction 
is possible only at the epochs < ri < T2 < • ■ ■ and has the following form. At time 
Tn with probability jy(jy_]^).."^(jy_fe_)_^-) a set of indices {ii, . . . ,ik) is chosen and the particle 
configuration (xi, . . . , xat) instantly changes to {yi, . . . , y^v) accordingly to the synchronizing 
map ^ (see (©). 

Note that the pairwise interaction defined in (l2|) is a particular case of the symmetric k- 
particle synchronizing interaction considered here. To see this put k = 2, I = 1, the signature 
(fci, ...,ki) = (2). Then 112 : (ii,'i2) ^ ^1, ^1 = (51,^) = (^i>*2), 91 = k, H = ^2. 

Let Ls^(^ki....,ki) denote a formal generator corresponding to the symmetric fc-particle inter- 
action of the signature (ki, . . . , ki). Main goal now is to generalize our results to the Markov 
process x{t) with generator 

(^nLq + 5NLs,{k^,...,ki) ^ o'TV > 0, 5n>^- 

All arguments of the proof in Section [3] can be repeated as well for this case, we should only 
to take care about an analog of Lemma O Fortunately, the proof of Lemma [3] for the general 
symmetric fc-particle interaction can be obtained by a slight modification of the proof of 
Lemma 2 in [7|. So there is no need to repeat that proof here. We mention only the explicit 
form of the constant x entering in definition of 

ktv = 1 



(A^- 1)A^ ■ 

It appears (see [7J) that x = X]j=i k'j — k. It is easy to check that x > for any ki > 2, . . ., 
ki >2 such that ki + ■ ■ ■ -\- ki = k. 

So our final conclusion is the following one. 

The both statements of Theorem\^ remains true for the particle system with symmetric k- 
particle interaction. Moreover, x = x(A;i, . . . ,ki) = kj — k. The choice of the sequence 

s \ ■ ik >^'^jv tjN) 
{onI is the same: ajy = 77^5 • 

Let us remark also that for the pairwise synchronization x((2)) = 2. 
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4.3 Nonmarkovian model: general renewal epochs for synchronization 

The next step in generalization of the model is to consider more general sequences {t^}. We 
replace Assumption M by the following one. 

Assumption Tjv. For each fixed E N the moments \ are epochs of some renewal 

L J n=l 



process, i.e., the sequence |rn^'' 



consists of independent random variables, 



having common continuous distribution function -F/v(s) 



isfying Fiv(s) 
variance d]\f. 



for s < 0. Intervals r, 



(TV) 



have finite mean yUjv > and 



l<4 



sat- 



Expected result is the following one. Consider a stochastic process x^^^ (t) = {xi{t), . . . , XAr(t)), 
t > 0, corresponding to N Brownian particles with diffusion coefficient > 0- Particles 
of x^^\t) interact at epochs |r,l^^ | according to the symmetric k-particle interaction of 

L J n=l 

the signature (fci, . . . ,ki). Let Assumption T^r holds. 

Conjecture. Assume that supiiAr(O) < oo. Let N — )• oo, t = t(N) —?■ oo. There are three 

N 

different time stages in the collective behavior of the particle system: 





I 


II 


III 


t{N) 


On 


ajv — > c > 


aN — >■ oo 


RN{t{N)) ~ 


a%t{N) 


(l-e-'^y-^altiN) 





where '■- 



>ct{N) 



3 = 1 



k. 



Evidently, x^^\t) is not a Markov process. Of course, we can not expect to have here 
an explicit representation for i?Ar(t) as in Theorem [3j Possible proofs of the Conjecture can 
be obtained by two different ways. The first one is close to Section 3 of the present paper. 
The idea is to represent RN{t) in term of generating function of the number of renewals Ilf : 
g{t,Q = E(^^^ (we recall that under Assumption T^v (H^, i > 0) is not a Poisson process). 
We are interested in the long time behavior (t — )• oo), so we take the Laplace transform of 
the function g{tX) in t (see [131 Section 3.2]), 



/(^,C) 



+ 00 



-St 



git,C)dt. 



to analyze its behavior for small s. Applying Tauberian theorems from [10', Ch. 13, Section 5] 
we come to the following statement. 



Theorem 6 Assume that supi?Af(0) < oo, A^ oo, t{N) oo. 

N 

If ON 0, then RN{t{N)) ~ a%t{N) Li{t{N)) . 
If UN oo, then RN{t{N)) ^ >i-^a%fj.N N^L2{t{N)) . 
Here Li and L2 are some slowly varying functions, notation is the same as in Conjecture. 

These results are slightly weaker than the corresponding items of Theorems H] or [5] but 
this is the best we can do by this method. We omit details. 
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The second possible way of proving the above conjecture is an approach based on em- 
bedded Markov chains. It was very effective in |6] and [7]. We shall devote to it a separate 
paper. 
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